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Abstract. Fock spaces over zeons are introduced. Trace identities 
and a noncommutative "integration- by-parts" formula are developed. 
As an application, we find a new criterion, without involving powers 
of the transition matrix, for a Markov chain to be ergodic. 



1 Introduction 

In second quantization, Fock spaces are customarily based on bosons or 
fermions. Here we consider Fock spaces based on "zeons". Zeons can be 
thought of as possessing a mix of fermionic and bosonic properties: they 
square to zero, yet they commute. 

In this paper we give our motivation and construction of the zeon Fock space, 
Z. We derive trace identities in the spirit of noncommutative integration 
for the degree two component of Z. Then we consider stochastic matrices 
specifically. We review the results on convergence of the Markov chain corre- 
sponding to a stochastic matrix. Namely, the matrix being "irreducible and 
aperiodic" is equivalent to ergodicity of the chain. For stochastic matrices, 
the zeon noncommutative integration-by-parts formula leads to a new cri- 
terion for the corresponding Markov chain to be irreducible and aperiodic, 
hence ergodic. Some concluding remarks round out the paper. 



2 Background 



The idea was developed from looking at semigroups of zero-one matrices 
representing functions acting on a finite set. Given a set S of n elements, 
let F{S) — {/: S S}. For a field of scalars, take the rationals, Q, as the 
most natural for our purposes and consider the vector space V = (Q™ with 
End (y) the space of n x n matrices acting as endomorphisms of V. We have 
the mapping 

F{S) ^End{V) 
taking / e F{S) to M(/) e End (V) defined by 

(M(/))„ = P' (1) 
^ " ^ 10, otherwise ^ ^ 

Denote by Fo{S) the semigroup consisting of F{S) with the operation of com- 
position, where we compose maps to the right: for i E S, i(/i/2) = /2(/i(^))- 
The mapping M gives a representation of the semigroup Fo{S) by endomor- 
phisms of V, i.e., Mif.h) = M{h)M{h). 

Now consider the exterior algebra, /\V . For W G End(l^), the exterior 
powers of W , W^^, act on V — /\ V in the standard way: 

W^''{vi AV2A... Avk) = Wvi A Wv2 A ... A Wvk . 

It is clear that for general matrices, Wi, W2, for each degree k, we have a 
representation of End {V) by endomorphisms of V^'^. That is, for each k, the 
induced map 

End {V) End (y^'^) : Wi W^'', W2 ^ W^'' 

satisfies 

Composing with M, for each k, we have a representation of the semigroup 
Fo{S) on V^^. However, since the Grassmann algebra has anticommuting 
generators, minus signs are introduced and exterior powers of M(/) do not 
correspond to functions. 

The remedy comes from the observation that in multiplying exterior powers 
of the matrices M(/i), M(/2), there is never any cancellation effect due to 
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the signs, as any row has at most a single non-zero entry, ±1. If the signs are 
ignored, then we still have a homomorphism at each degree k, and products 
of the associated matrices will correspond to functions. 

We conclude this section with some notation. The details of our construction 
is the subject of the next section. 

2.1 Notations 

Here we collect some notational conventions used throughout the paper. 

We treat vectors as "row vectors", i.e., 1 x n matrices, with as the cor- 
responding standard basis vectors. The cohimn vector corresponding to v 
is vK For a matrix M, M* denotes its transpose. And diag(f ) denotes the 
diagonal matrix with entries Vi of the vector v. 

The vector having components all equal to 1 is denoted u. And the matrix 
J = u^u has entries all ones. We use the convention that the identity matrix, 
/, as well as u and J, denote matrices of the appropriate size according to 
the context. 



3 Construction of zeon algebra 

Consider the exterior algebra generated by a chosen basis {cj} C V ^ with 
relations Cj A Cj = —ej A e^. Denoting multi-indices by roman capital letters 
I = (^1, '^2, • • • , ik), J, K, etc., at level k, a basis for V^'' is given by 

ei = Cj, A • • • A 

with I running through all fc-subsets of {1,2,..., n}, i.e., A;-tuples with dis- 
tinct components. For M{f), f e F{S), define the matrix 

mfr%-\mfr%\ 

taking absolute values entry-wise. It is important to observe that we are 
not taking the fully symmetric representation of End (V) , which would come 
by looking at the action on boson Fock space, spanned by symmetric ten- 
sors. However, note that the fully symmetric representation is given by maps 
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induced by the action of M(f) on the algebra generated by commuting vari- 
ables {cj}. We take this viewpoint as the starting point of the construction 
of the zeon Fock space, Z, to be defined presently. 

Definition A zeon algebra is a commutative, associative algebra generated 
by elements such that ef = 0, i > 1. 

For a standard zeon algebra, Z, the elements are finite in number, n, and 
are the basis of an n-dimensional vector space, V p=i Q"^. We assume no 
further relations among the generators Cj. Then the k^^ zeon tensor power 
of V, denoted V^'^, is the degree k component of the graded algebra Z, with 
basis 

analogously to the exterior power except now the variables commute. The 
assumptions on the Cj imply that V^*^ is isomorphic to the subspace of sym- 
metric tensors spanned by elementary tensors with no repeated factors. As 
vector spaces, 

The zeon Fock space is Z presented as a graded algebra 

fc>i 

Since V is finite-dimensional, k runs from 1 to n = dimV. 

A linear operator W e End (V) extends to the operator W^'' e End(V^'^). 
The second quantization of W is the induced map on Z. 

For the exterior algebra, the IJ*'' component of W^^ is the determinant of 
the corresponding submatrix of W, with rows indexed by I and columns by 
J. Having dropped the signs, the IJ*'^ component of W'^'^ is the permanent 
of the corresponding submatrix of W. 

For W of the form M[f ) corresponding to a function / G F(S), the resulting 
components of W'^'' are exactly the absolute values of the entries of W^'', as 
we wanted. At each level k, there is an induced map 

End (V) ^ End (V''*^) , M(/) ^ M{f)'"' 
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satisfying 



{M{fj2)r = {M{f,)M{f2)r = M{hY'MU2r (2) 

giving, for each fc, a representation of the semigroup Fo{S) as endomorphisms 
of V^'^. However, for general Wi, W2, the homomorphism property, ([2]), no 
longer holds, i.e., (WiW2y^ does not necessarily equal Wi^'' W2^'' ■ It is not 
hard to see that a sufficient condition is that Wi have at most one non-zero 
entry per column or that W2 have at most one non-zero entry per row. For 
example, if one of them is diagonal, as well as the case where both correspond 
to functions. 

What is the function, fk, corresponding to M{fY^ ^ i.e., such that M{fk) = 
M{fy' ? For degree 1, we have from ([T]) 

e.M(/) = ef^i) (3) 

And for the induced map at degree A;, taking products in 

ejMifr' = (e,M(/))(e,M(/))---(e.,M(/)) 

We see that the degree k maps are those induced on /c-subsets of S mapping 

-> {/(Zi),...,/(ifc)} 

with the property that the image in the zeon algebra is zero if f{ii) = f{im) 
for any pair i;, im- Thus the second quantization of M(/) corresponds to the 
induced map, the second quantization of /, extending the domain of / from 
S to the power set 2*^. 

The main features of our construction have been shown. After some prelimi- 
naries in the next subsection, we continue with noncommutative integration, 
focusing on level 2. 

3.1 The degree 2 component of Z 

Working in degree 2, we denote indices I = («, j), as usual, instead of {11,12)- 
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For given n, X, Y, etc., are vectors in ~ 

As a vector space, V is isomorphic to Q". Denote by Sym(V) the space of 
symmetric matrices acting on V. 



Definition The mapping 

Mat: ^ Sym(V) 

is the hnear embedding taking the vector X = (xij) to the symmetric matrix 
X with components 

y ^jXij, iori<j 
I 0, for i = j 

and the property Xji = Xij fills out the matrix. 

We will use the explicit notation Mat(X) as needed for clarity. 

Equip V"^^ with the inner product 

{X,Y) ^tiXY . 

Throughout, we use the convention wherein repeated Greek indices are au- 
tomatically summed over. So we write 



{X,Y)=Xx^,Y, 



4 Basic Identities 

Multiplying X with u, we observe that 



Xu^ ^-trXJ ^uX^ (4) 
2 ^ ^ 



Observe also that if D is diagonal, then ti D = tiDJ. 
Proposition 4.1 (Basic Relations) We have 
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1. Meit{X A'^'^) — A*XA — , where is a diagonal matrix satisfying 
txD+ ^txA*XA. 

2. Mat(A^^X^) = AX A* — D~ , where D~ is a diagonal matrix satisfying 
IyD- = trAXA*. 

3. If A and X have nonnegative entries, then and D~ have nonnegative 
entries. In particular, in that case, vanishing trace for implies vanishing 
of the corresponding matrix. 

Proof: The components of XA'^'^ are 

{XA'^)ij = 0ij9x,,{x),f,AxiAi,j + xxi,Ai,iAxj) 
= eij{A*XA)ij 
with the theta symbol for pairs of single indices 

1 0, otherwise 

Note that the diagonal terms of X vanish anyway. And A*XA will be sym- 
metric if X is. Since the left-hand side has zero diagonal entries, we can 
remove the theta symbol and compensate by subtracting off the diagonal, 
call it Taking traces yields #1. And #2 follows similarly. □ 

Remcirk. Observe that D'^ and D~ may be explicitly given by 

D^i = 2 xx^AxiAfj^i 

where for the A elements are taken within a given column, while for D~, 
the A elements are in a given row. 



Proposition 4.2 Let X and A be nonnegative. Then 

X = A*XA =^ XA^^ = X 
X^AXA* =^ A'^'^X^^X^ 
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Proof: We have 

D+ = A*XA - Mat(XA^2) 

If X = A*XA, then since X has vanishing trace, tr A*XA = 0. So tr = 0, 
hence D+ = 0, and X = A*XA = Mat(XA^2) jhe second imphcation fol- 
lows similarly. |--| 



5 Trace Identities 

Using equation (j4j), we will find some identities for these quantities. 



Proposition 5.1 We have 

1. XA^V = itr(XA(J-/)A*) . 

2. uA^'^X^ = - tr {XA*{J -I) A) . 

3. If A is stochastic, then XA"^^u^ = ^ti {X {J - AA*)). 

Proof: We have, using equation (jl]) and Basic Relation 1, 
XA^V = itrMat(XA^2)j 

= ^ti {A* XAJ - D+ J) 

= ^ti {A* XAJ - A*X A) 

and rearranging terms inside the trace yields #1. Then #3 follows since 
A stochastic implies A J = J = J A*. And #2 follows similarly, using the 

second Basic Relation in the equation uA^^X^ = - tr Mat(y4'^^X^) J. □ 
Using equation (j4]) directly for X, we have 

X{I-A''^)u^ = ^ti {X {J - AJ A* + AA*)) (5) 
u(/-A^2)X^ = ^ti {X{J - A* JA + A* A)) (6) 
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5.1 Stochastic case 

For stochastic A, equation ([5]) yields 

Lemma 5.2 ("integration-by-parts for zeons") 

X{I - A'^)u^ = ^ti A* X A (7) 

5.2 Markov-Perron-Frobenius theory 

Let's recall the basic facts about the convergence of a Markov chain with 
transition matrix A. 

We denote an invariant distribution for A by vr, i.e. ttA = tt = {pi, . . . ,Pn)- 
A is ergodic, if A"' converges to lim A"' = = u^tt, satisfying ^l^ = n = 

n — >oo 

An = QA. 

The state transition diagram, STD, of A is the directed graph with vertices 
{1, . . . ,n} with an edge from i to j if Aij > 0. 

The notions of irreducibility and aperiodicity in terms of the STD may be 
taken as definitions. For an alternative approach with details, see [U Ch4, 
§3]. 

A is irreducible if for every pair {i,j) there is a path in the STD with initial 
vertex i and final vertex j. That is, the STD is strongly connected. 

In the reducible communicating class, C, is a set of states that forms 

a strongly connected component of the STD. If there are no transient states, 
these classes comprise a partition of the set of states. This is the situation 
we are considering here. 

A cycle in the STD is a path with equal initial and final vertices. 

For A irreducible, it is aperiodic if the greatest common divisor of all cycle 
lengths is 1. 
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Taking terminology from [Ij , say that A is quasi-positive if some power m G N 
of A, A"^, has all positive entries. The basic results are these: 

Theorem A P Ch.3, Th.2.1],[4, Th.2.9] 

A is irreducible and aperiodic if and only if it is quasi-positive. 

and 

Theorem B H Th.2.4], Ch.5, §2] 

A is ergodic if and only if it is quasi-positive. 

In other words, 

Corollary C A is ergodic if and only if it is irreducible and aperiodic. 
And quasi-positivity serves as a test criterion. 

For a general setting, see [H Ch. 5, §2], where in the Appendix it is remarked 
that the implication "quasi-positive implies ergodic" goes back to Markov [2] . 

Recall that there may be transient states forming a class, T, such that even- 
tually the chain leaves T and enters a closed ergodic class of states. In this 
case, A will have a left eigenvector with eigenvalue 1, i.e., a left-invariant 
vector, with zero entries. We will not consider this case. 

Next we derive a new criterion for ergodicity. 

5.3 Ergodicity of a stochastic matrix 

First, a converse result to Proposition 14. 2[ 

Proposition 5.3 Let A be stochastic and X nonnegative. 

1. AA^2 ^x^X = A*XA. 

2. If A has a strictly positive invariant distribution, it, then 
A^^X^ = At ^ A = AX A* . 
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Proof: If XA^"^ = X, then Proposition I4.H eq. 1, reads 

X = A*XA - D+ 

Multiply by on the right and by u on the left, using Au^ = u"^ and uA* = u 
to get 

uXu'^ = uXu^ — uD^u^ 
So uD^u^ = and taking traces yields tr (D^J) = 0, thus = 0. 

If A^^X"!" = X^, then Proposition 14.11 eq. 2, reads 

X = AX A* - D- 

Multiply by vr^ on the right and by tt on the left, using irA = vr and A*'n-'^ = vr^' 
to get 

ttXtt^ = ttXtt^ — -rD^tt^ 
So 7rD~n^ = and taking traces yields tr (D^ttW) = 0. I.e., DuPl. = 0; 

so £)- = 0. ' □ 

With A stochastic, irreducible and aperiodic, lim A"' = Vt = u^tt, satisfying 
= n = An = nA. observe that 

= v)'K'k^u = {Y.p1)J 
both of these having all positive entries. Thus 

Proposition 5.4 Let A be stochastic, irreducible and aperiodic. Then, for 
nonnegative X , either of X = AX A* or X = A*XA implies X = 0. 

Proof: If X = AX A*, then, inductively for positive integers k, 

X = A''X{A*)'' 

Letting k oo, we have X = QXQ*. Taking traces yields trXQ*Q = 0. 
Since X is nonnegative and Q*Q is a matrix with positive entries, we have 
X = 0. The proof for X = A*XA is similar. r-| 
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Theorem 5.5 



1. Let A have a strictly positive left-invariant vector. Then det(/ — vl^^) 7^ 
implies that A is irreducible and aperiodic. 

2. If A is irreducible and aperiodic, then det{I — A^^) ^ 0. 



Proof: For A reducible, let {Cq, . . . , Cg-i}, s > 1, denote the communicat- 
ing classes partitioning the states. Define X by Xij = if there is a k such 
that i,j e Cfc, 1 otherwise, i.e., 

k 

We will show that A'^^X^ = Xl 



Step 1. First check that the diagonal vanishes, i.e., AixXx^j^Ai^ = 0. By as- 
sumption, if i e Cfc, then A, e C^. But then — 0. 

Step 2. For i ^ j, {A'^'^X^)ij = xx^,{A,xAj^ + Ai^Ajx). Consider the first 
sum, as the second is similar. If i G Ck, then the sum is over A G Cfc. If 
j e Ck, then the sum is over fj, E as well, X\^ = 0, and the result is zero. If 
j e Ck', k' 7^ k, then = 1. Writing out the sums, and exchanging indices 
in the second sum, since xi^ — 1 as I and m range in different classes. 



For fixed m, the sum over I e gives all choices that i could map to, with 
Ail = for Z ^ Cfe, so Ail — 1. Similarly, summing over m gives 1. Hence, 

we get 1 in case Xij 7^ and otherwise, as required. 

If A is irreducible and periodic, with period p, say, let {Cq, . . . , Cp^i} denote 
the classes partitioning the states such that i E Ck implies iA e Cfe+i, with 
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indices modulo p. Define X by Xij = 1 if there exists k such that i G Ck 
and j G Ck+i, or j G Ck and i G Ck+i- Otherwise, Xij = 0. We check that 
^v2j^t = . The steps are similar to that for the case of reducibility: 

Step 1. First check that the diagonal vanishes, i.e., Ai\Xx^Aifj_ = 0. By pe- 
riodicity, if z G Cfc_i, then A G and hence /i G Ck+i or yU G Ck-i, by 
definition of X. But then vanishes since fi G C^+i requires i E Ck and 
/i G Ck-i requires i G Cfc_2. 

Step 2. For i ^ j, (A^^j^t)^^. = XA^(AaAj;. + Ai^Ajx). Let z G C^. Then 
A G Cfc+i gives fi e Ck or fi e Ck+2, finally, j G Ck-i or j G C^+i. And then 
Xij = 1. The other case is /i G C^+i which gives A G or A G Ck+2 and 
again j G Cfe_i or j G C^+i, with the conclusion Xij = 1. Otherwise we get 
Xij = 0. Writing out the sums, in all cases, xim = 1- We get, for j G Ck-i, 

AilAjm + AimAji 

and for j G C^+i, 

Note that the four sums have no overlapping terms, except if j9 = 2, then 
both cases for j are the same. In the first sum, for fixed m, the sum over / 
gives all choices that i could map to, yielding 1, and summing over m gives 
1 as well. The other three sums are similar, adding in each case to 1. Hence, 
we get 1 in case Xij ^ and otherwise, as required. 

Suppose A is aperiodic and irreducible. By Perron- Frobenius applied to A^'^, 
its top nonnegative eigenvalue, Aq, has a nonnegative eigenvector, X, |3l 
Ch. 1, Th. 4.4]. First we show that Aq < 1, so that if 1 is an eigenvalue, it is 
the top nonnegative eigenvalue. By Lemma [5. 2 [ we have, with Xu^ > 0, 

X{I - A^2)^t = x(l - Ao)^^ = (1 - Xo)Xu^ = ^ tr {A*XA) > . 

Now, if XA"^"^ = X, then Aq = 1. So the corresponding eigenvector X is non- 
negative. Proposition 15.31 says that XAl''^ = X implies X = A*XA. Then 
Proposition 15.41 yields X = 0. r-| 
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5.4 Some examples 

Here are some examples illustrating a variety of cases. 



Example. Let 



then 



with det(/ - A 



V2\ 



1/4 1/4 1/2 ■ 

1/4 1/4 1/2 
1 

1/8 1/4 1/4 

1/4 1/4 

1/4 1/4 
7/16 7^ 0. The limit 

"0 1 



lim A" 

n—i-oo 








exists, with zeros corresponding to the transient states {1,2}. 

Example. Here there are two absorbing states, {2,4}, with transient {3} 
having the possibility to go to either of them. 



then 



■1/2 


1/2 





" 







1 













1/2 





1/2 













1 




1/2 











" 


1/4 


1/4 





1/4 








1/2 





1/2 














1/2 














1 














1/2 
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lim A' 

n— ►oo 



with det(7 - A^'^) = 0. The hmit 

10 
10 

1/2 1/2 
1 

exists. A left-invariant vector of A is a linear combination of 

{[0,1,0,0], [0,0,0,1]} 
while a left-invariant vector of A^'^ is a multiple of 

[0,0,0,0,1,0] 

having a 1 in the (2,4) spot. A right-invariant vector of A^'^ is a multiple of 



12 12 1 



it 



noting that A^"^ does not necessarily have constant row sums. 



Example. Here's a reducible case, no transients. 

" 1/2 1/2 
1/2 1/2 
A= 1/2 1/2 
1/2 1/2 
1/2 1/2 
A left-invariant vector of A has the form 

[a;2,a;2,a:i,a;i,xi] 

with Xi arbitrary. Closed classes are {1, 2}, {3, 4, 5}. Solutions X to A'^'^X'^ — 
X"^ satisfy 

Q w\ w\ wi 
Q wi wi wi 
X = wi wi 
wi 
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with arbitrary parameters Wi. This is the solution appearing in the above 
proof. 



Example. This case is periodic, without transients. 

10 



1/2 1/2 







1 















1 
1 





Any left-invariant vector oi A is a multiple of 

[2,2,1,1,2] 
Solutions X to A^^^t = satisfy 



X = 



with arbitrary w,. The periodic classes are {1}, {2}, {3, 4}, {5}. For a fixed 

S, a basic right-invariant vector for is given by = 1 if dist = 5, 
otherwise. Here, distance is the shortest vahic \k — k'\, labelling the classes 
consecutively modulo 4, with i & Ck, j E Ck'- The analogous construction 
works for general period p. In the above proof, we specialized io 5 — 1. 

Example. Our concluding example is both reducible and periodic. 






W2 


Wi 


Wi 


W2 


W2 





W2 


W2 


Wi 


Wi 


W2 








W2 


Wi 


W2 








W2 


W2 


Wi 


W2 


W2 






A^ 



' 


1 


























1 














1 














1 














1/2 











1/2 


1 
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with left-invariant vectors of the form 

[x2,2X2,Xi,Xi,2X2,X2] 

for arbitrary Xj. The periodic classes are {1, 5}, {2, 6}, {3, 4}, with closed 
classes {1, 2, 5, 6}, {3, 4}. Solutions X to A^^X^ = X^ have the form 



X = 








W2 


W3 





W4 







W3 


W2 







W2 


W3 





Wi 


W2 


W3 


W3 


W2 


Wi 





W3 







W4 


W2 


W3 







W4 





W3 


W2 


W4 






with the Wi arbitrary. 



6 Conclusion 

After introducing the zeon Fock space, we have found some basic identities 
and properties for the corresponding noncommutative integration at level 2. 
These are used to find a criterion for a Markov chain to be irreducible and 
aperiodic. 

There are interesting applications to semigroups of matrices representing 
functions acting on a finite set. These can be related to directed graphs of 
constant out-degree. This work will appear separately. 

Extensions to countable state space look to be interesting possibilities for 
further work, [H Ch. 4 §4] . 
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